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Abstract — Cognitive radio (CR) technology is regarded as a 
promising solution to the spectrum scarcity problem. Due to 
the spectrum varying nature of CR networks, unlicensed users 
are required to perform spectrum handoffs when licensed users 
reuse the spectrum. In this paper, we study the performance 
of the spectrum handoff process in a CR ad hoc network 
under homogeneous primary traffic. We propose a novel three 
dimensional discrete-time Markov chain to characterize the 
process of spectrum handoffs and analyze the performance of 
unlicensed users. Since in real CR networks, a dedicated common 
control channel is not practical, in our model, we implement 
a network coordination scheme where no dedicated common 
control channel is needed. Moreover, in wireless communications, 
collisions among simultaneous transmissions cannot be immedi- 
ately detected and the whole collided packets need to be retrans- 
mitted, which greatly affects the network performance. With this 
observation, we also consider the retransmissions of the collided 
packets in our proposed discrete-time Markov chain. In addition, 
besides the random channel selection scheme, we study the impact 
of different channel selection schemes on the performance of 
the spectrum handoff process. Furthermore, we also consider 
the spectrum sensing delay in our proposed Markov model and 
investigate its effect on the network performance. We validate 
the numerical results obtained from our proposed Markov model 
against simulation and investigate other parameters of interest in 
the spectrum handoff scenario. Our proposed analytical model 
can be applied to various practical network scenarios. It also 
provides new insights on the process of spectrum handoffs. 
Currently, no existing analysis has considered the comprehensive 
aspects of spectrum handoff as what we consider in this paper. 

I. Introduction 

According to the frequency chart from the Federal Com- 
munications Commission (FCC), almost all radio spectrum 
suitable for wireless communications (3kHz-300GHz) has 
been allocated. However, recent studies indicate that much of 
the radio spectrum is not in use for a significant amount of 
time and in a large number of locations. A report from FCC 
shows that up to 85% of the assigned spectrum is underutilized 
due to the current static spectrum allocation policy [1|. This 
spectrum underutilization leads to a new dynamic spectrum 
allocation paradigm approved by FCC which allows users to 
exploit temporal and spatial spectrum holes or white spaces in 
a radio environment (2). Cognitive radio (CR) is considered 
as a key technology to implement dynamic spectrum access 
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(DSA) that allows an unlicensed user (or, secondary user) 
to adaptively determine appropriate operating parameters to 
access the licensed spectrum band which is not occupied by 
licensed users (or, primary users) |U| . 

Since secondary users (SUs) are regarded as visitors to 
the licensed spectrum, cognitive radio networks bring about 
unique challenges in designing novel spectrum management 
functions because of their coexistence with legacy networks. 
One critical challenge is that SUs should avoid causing harm- 
ful interference to primary users (PUs) and support seamless 
communications regardless of the appearance of PUs. In 
particular, one of the most important functionalities of CR 
networks is spectrum mobility which refers to the capability 
of SUs to change the operating frequencies based on the 
availability of the spectrum. Spectrum mobility gives rise 
to a new type of handoff called spectrum handoff which 
refers to the process that when the current channel used by 
a SU is reclaimed by a PU, the SU needs to pause the on- 
going transmission, vacate that channel, and determine a new 
available channel to continue the transmission. Needless to 
say, spectrum mobility is essential for the performance of SU 
communications. However, most existing work on CR net- 
works focus on other functionalities of CR networks (spectrum 
sensing, spectrum management, and spectrum sharing) [2J, 
while spectrum mobility is less investigated in the research 
community. Various models have been proposed to address the 
performance analysis issue of the other three functionalities 
[4|-[7|, but not spectrum mobility. 

Related work on spectrum handoffs in CR networks falls 
into two categories based on the moment when SUs carry out 
spectrum handoffs. In the first category, SUs perform channel 
switching after detecting the reappearances of PUs, namely 
the reactive approach 181- fTOl . In the other category, SUs 
predict the future PU channel activities and perform spectrum 
handoffs before the disruptions with PU transmissions, namely 
the proactive approach [11|-[14|. With the exception of [9| 
and [ 10 1, the performance analysis of all prior works on 
spectrum handoffs is simulation-based. 

An analytical model is of great importance for performance 
analysis because it can provide useful insights on the operation 
of spectrum handoffs. However, there have been limited stud- 
ies on the performance analysis of spectrum handoffs in CR 
networks using analytical models. In [9 1 and [ 10 1, a preemptive 



resume priority queueing model is proposed to analyze the 
total service time of SU communications for proactive and 
reactive-decision spectrum handoffs. However, in both |]9] 
and [ 1 1 , only one pair of SUs is considered in a network, 
while the interference and interactions among SUs are ignored, 
which may greatly affect the performance of the network. 
Additionally, although they are not designed for the spectrum 
handoff scenario, some recent related works on analyzing the 
performance of SUs using analytical models can be found in 
ifTSI and lfl6l . In fl5l . a dynamic model for CR networks 
based on stochastic fluid queue analysis is proposed to analyze 
the steady-state queue length of SUs. In 1161 . the stationary 
queue tail distribution of a single SU is analyzed using a large 
deviation approach. In all the above proposals, a common and 
severe limitation is that the detection of PUs is assumed to be 
perfect (i.e., a SU transmitting pair can immediately perform 
channel switching if a PU is detected to appear on the current 
channel, thus the overlapping of SU and PU transmissions is 
negligible). However, since the power of a transmitted signal is 
much higher than the power of the received signal in wireless 
medium due to path loss, instantaneous collision detection is 
not possible for wireless communications. Thus, even if only 
a portion of a packet is collided with another transmission, the 
whole packet is wasted and need to be retransmitted. Without 
considering the retransmission, the performance conclusion 
may be inaccurate. Unfortunately, it is not easy to simply add 
retransmissions in the existing models. In this paper, we model 
the retransmissions of the collided packets in our proposed 
Markov model. To the best of our knowledge, this is the first 
paper that considers the retransmissions of the collided packets 
in spectrum handoff scenarios. 

Furthermore, in the prior proposals, the network coordina- 
tion and rendezvous issue (i.e., before transmitting a packet 
between two nodes, they first find a common channel and 
establish a link) is either not considered Jg) [10] £l2) 03] 
lfl5l ifTSI or simplified by using a dedicated common control 
channel (CCC) flj] E) . Since the dedicated CCC is 
always available, a SU can coordinate with its receiver at any 
moment when there is a transmission request. However, it is 
not practical to use a dedicated CCC in CR networks because 
it is difficult to identify a dedicated common channel for all 
the SUs throughout the network since the spectrum availability 
varies with time and location. In this paper, we do not make 
such assumption. We model the scenario where SUs need to 
find an available channel for network coordination. Therefore, 
in this paper, we consider a more practical distributed network 
coordination scheme in our analytical model design. 

In this paper, we also explore the effect of different channel 
selection schemes on the performance of the spectrum handoff 
process using our proposed Markov model. Besides the general 
random channel selection scheme, different channel selection 
schemes have been proposed for various design goals [9] [17] 
[ 18 1. These channel selection schemes can be easily adopted in 
our proposed three dimensional discrete-time Markov chain if 
we apply different state transition probabilities in the proposed 
analytical model. 



In addition, we also consider the impact of the spectrum 
sensing delay on the performance of the spectrum handoff 
process. Since the overlapping time of a SU and PU collision 
is not negligible, we define the spectrum sensing delay as the 
duration from the moment a collision happens to the time a 
SU detects the collision. The spectrum sensing delay can be 
easily employed in our proposed Markov model with minor 
modifications. 

In summary, in this paper, we study the performance of 
SUs in the spectrum handoff scenario in a CR ad hoc network 
where PU traffic on each channel is identical. The main 
contributions of this paper are given as follows: 

1) We propose a novel three dimensional Markov model 
to characterize the process of spectrum handoffs and 
analyze the performance of SUs. The interference and 
interactions among multiple SUs are considered in our 
proposed model. 

2) Due to the spectrum-varying nature of CR networks, in 
our model, we implement a more practical coordination 
scheme in our proposed model instead of using a dedi- 
cated CCC to realize channel rendezvous. 

3) Since instantaneous collision detection is not feasible for 
wireless communications, we consider the retransmis- 
sions of the collided SU packets in spectrum handoff 
scenarios. 

4) We apply three different channel selection schemes in 
the proposed Markov model and study their effects on 
the performance of SUs in spectrum handoff scenarios. 

5) We consider the spectrum sensing delay and its impact 
on the network performance. This feature can be easily 
implemented in our proposed Markov model. 

Therefore, our model is very flexible and can be applied to 
many practical scenarios with various designs. 

The rest of this paper is organized as follows. In Section 
iHl the network coordination scheme and the spectrum handoff 
process considered in this paper are introduced. In Section [Till 
a three dimensional discrete-time Markov model is proposed. 
In Section [IV] and [V] the performance analysis for different 
channel selection schemes and the spectrum sensing delay is 
given. Numerical results using the proposed Markov model 
are presented in Section |VI] followed by the conclusions in 
Section ED 

II. Network Coordination and Spectrum Handoff 

A. Network Coordination Scheme 

Throughout this paper, we consider a network scenario 
where TV pairs of SUs form a CR ad hoc network and oppor- 
tunistically access M identical licensed channels. We use the 
common frequency-hopping sequence approach as the network 
coordination scheme [19| [20|. Fig. [TJ illustrates the operations 
of the common frequency-hopping sequence approach, where 
the channels are time-slotted and SUs communicate with each 
other in a synchronous manner. This is similar to the frequency 
hopping technique used in Bluetooth. When no packet needs 
to be transmitted, all SUs are required to follow the same 



channel-hopping sequence to hop through the band (e.g., the 
hopping pattern cycles through channels 1, 2, • • • , M). If a pair 
of SUs wants to initiate a transmission, they first exchange 
request-to-send (RTS) and clear-to-send (CTS) packets during 
a time slot. Then, after the SU transmitter successfully receives 
the CTS packet, they pause the channel hopping and start 
data transmissions on an available channel, while other non- 
transmitting SUs continue the channel-hopping. The selected 
channel information is contained in the RTS packet. After the 
data being successfully transmitted, the SU pair should switch 
back to the channel-hopping sequence and rejoin the channel- 
hopping. In this paper, we define the length of a time slot as 
the transmission delay of sending one RTS/CTS pair. We also 
assume that spectrum sensing is perfect (i.e., SUs can sense 
all the channels simultaneously and always make the correct 
decisions). 
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Fig. 1. An example of the network coordination scheme. 

In this paper, we assume that any SU data packet is 
transmitted at the beginning of a time slot and ends at the 
end of a time slot. This implies that the length of a SU packet 
is a multiple of a time slot. This assumption is commonly 
used in time-slotted systems [21] [22] . We further define that 
a SU packet is segmented into frames and each frame contains 
c time slots. At the end of a frame, the two SUs can either 
rejoin the channel hopping when a data transmission ends, 
or start another frame on the same channel. Therefore, if a 
SU packet collides with a PU packet, only the collided frame 
will be retransmitted while the successfully received frames 
will not be retransmitted. Thus, the probability of successfully 
transmitting a whole packet is improved. 

B. Spectrum Handoff Process 

Fig. |2] shows an example of a spectrum handoff process 
considered in this paper in a three-channel scenario. Before 
a data transmission starts, SUs hop through the channels 
following the same frequency-hopping sequence. Once a suc- 
cessful RTS/CTS handshake between a SU transmitter and its 
receiver takes place, the two SUs pause the channel hopping 
and start the data transmission. If a PU packet transmission 
starts in the middle of a SU transmission, the transmitter 
cannot instantaneously detect the collision. Thus, the SU 
transmitting pair will know the collided transmission till the 
end of the frame (e.g., the transmitter does not receive the 
acknowledgment (ACK) from the receiver). Then, the two SUs 
resume the channel hopping for coordination until they find 
another idle channel for the retransmission of the previously 
unsuccessful frame. On the other hand, if a SU frame does 



not collide with a PU packet, the SU transmitter continues to 
transmit the next frame on the same channel until all frames 
are successfully transmitted. successful frame 

transmission 




frequency 



Fig. 2. An example of the spectrum handoff process. 

III. The Proposed Three Dimensional 
Discrete-time Markov Model 

In this section, we develop a Markov model to analyze the 
performance of the spectrum handoff process. For simplicity, 
we assume the same number of neighbors per SU, which 
permits us to focus on any SU to analyze the performance. 
We ignore the propagation delay or any processing time in 
our analysis. We also assume that the destination of any data 
packet from a SU transmitter is always available, that is, the 
probability that the selected SU receiver is not busy is one. 

A. The Proposed Markov Model 

Based on the time slotted channels, any action of a SU can 
only be taken at the beginning of a time slot. In addition, 
the status of a SU in the current time slot only relies on its 
immediate past time slot. Such discrete-time characteristics 
allow us to model the status of a SU using Markov chain 
analysis. From Fig. [2] the status of a SU in a time slot can 
only be one of the following: 

1) Idle: no packet arrives at a SU. 

2) Transmitting: the transmission of a SU does not collide 
with PU packets in a time slot, i.e., successful transmis- 
sion. 

3) Collided: the transmission of a SU collides with PU 
packets in a time slot, i.e., unsuccessful transmission. 

4) Backlogged: a SU has a packet to transmit in the buffer 
but fails to access a channel. 

Note that there are two cases that a SU can be in the 
Backlogged status. In the first case, when a SU pair initiates a 
new transmission, if multiple SU pairs select the same channel 
for transmissions, a collision among SUs occurs and no SU 
pair can access the channel. Thus, the packet is backlogged. 
Similarly, in the second case, when a SU pair performs a 
spectrum handoff, if multiple SU pairs select the same channel, 
a collision among SUs occurs and the frame in every SU is 
also backlogged. 

As mentioned in Section U we consider the scenario that 
when a collision between a SU and PU happens, the overlap- 
ping of a SU frame and a PU packet is not negligible. Thus, the 
number of time slots that a SU frame collides with a PU packet 
is an important parameter to the performance of SUs. Based on 



the above analysis, the state of the proposed Markov model 
at time slot t is defined by a vector (N t (t), N c (t), Nf(t)), 
where Nt(t), N c (t), and Nf(t) denote the number of time 
slots including the current slot that are successfully transmitted 
in the current frame, the number of time slots including 
the current slot that are collided with a PU packet in the 
current frame, and the number of frames that have been 
successfully transmitted plus the current frame that is in the 
middle of a transmission at time slot t, respectively. Therefore, 
N t (t) + N c (t) < c. Fig. [3] shows the state transition diagram 
of our proposed three dimensional Markov chain. There are 
totally (h + 1) tiers in the state transition diagram. For each 
tier, it is a two dimensional Markov chain with a fixed Nf(t). 
Table Q] summarizes the notations used in our Markov model. 




Fig. 3. The transition diagram of the proposed Markov model. 

From Fig. [3] it is observed that the proposed Markov model 
accurately capture the status of a SU in a time slot. The state 
(JVt(t)=Q, N c (t)=0, N f (t)=0) in Fig.[3]represents that a SU is 
in the Idle status. Similarly, the states (N t (t) G[l, c], N c (t) = 
0,Nf(t) G represent the Transmitting status, i.e., no 

collision. The states (N t (t) G [0,c-l],N c {t) G [l,c],N f {t) G 
[l,h]) represent the Collided status. At last, the states (N t (t)= 



TABLE I 

Notations Used in the Markov Analysis 



Symbol 


Definition 


V 


Probability that a PU packet arrives in a time slot 


s 


Probability that a SU packet arrives in a time slot 


h 


Number of frames in a SU packet 


c 


Number of time slots in a frame 


1 


Probability of a collision among SUs 


u 


Probability that at least one channel is idle 



0, N c (t)=0, Nf(t) G [l,h]) represent the Backlogged status, 
where (N t (t)=0, N c (t)=0, N f (t)=l) is the Backlogged status 
during a new transmission. As shown in Fig. [3] the feature of 
the common frequency-hopping sequence scheme is captured 
in our model that a SU can only start a new transmission when 
there is a channel available. In the following discussion, we 
use the terms "states" in our proposed Markov model and the 
"status" of a SU in a time slot interchangeably. We also use 
the notations (N t (t + l) = i,N c (t + l)=j,N f (t+l)=k) and 
(i,j,k) to represent a state interchangeably. 

B. Derivation of Steady-State Probabilities 

To obtain the steady-state probabilities of the states in the 
three dimensional Markov chain shown in Fig. [3] we first get 
the one-step state transition probability. We denote the one- 
step state transition probability from time slot t to t + 1 as 

P{t ll j ll k 1 \i Q ,j Q ,k )=P(N t (t+l)=i 1 ,N c (t + l)=j 1 ,N f (t + 
l)=ki\N t (t)=io,N c (t)=jo,Nf(t) = k ). Thus, the non-zero 
one-step state transition probabilities for any < io < c, < 
jo < c, and < ko < h are given as follows: 

' P(0,0,fc o |0,0,fc o ) =«tt+(l-tt) 

P(l,0,*d|0,0,*dj=t»(l-p)(l-«) 

P(0,l,Ad|0 1 0,A )=ttp(l-«) 

P(io,h + l^oNo, jo,fco) = 1 

P(i , l,fc |io,0, k ) = p 

P(i + l,0,fco|io,0, ko) = 1 -p 

P(l,0,ko + l\c,0,k ) = 1- P { ' 

P(0,l,ko + l\c,0,k )=p 

P(0,0,0|c,0,/i) = 1 -s 

P(0,0,l|c,0,/i) = s 

P(0,0,0|0,0,0) = 1 -s 
k P(0,0,l|0,0,0) = s 
Let P (M ,fc) = lim^oo P(N t (t)=i, N c (t) =j,N f (t)=k),i G 
[0, c] , j G [0, c], k G [0, h] be the steady-state probability of the 
Markov chain. We first study a simple case where no PU exists 
in the CR network. Then, we consider the scenario where SUs 
coexist with PUs. 

1) No PU Exists in a Network: In this case, since the 
probability that a PU packet arrives in a time slot is equal to 
zero (i.e., p = 0), all channels are always available for SUs (i.e., 
u=l) and a SU does not need to perform spectrum handoffs 
during a data transmission. Thus, a SU cannot be in the 
Collided state. In addition, a SU can only be in the Backlogged 
state when it initiates a new transmission (i.e., the Backlogged 
states are reduced to (N t (t)=0, 2V c (t)=0, iV/(i)=l). Thus, the 
steady-state probabilities of the Transmitting and Idle state can 
be represented in terms of the steady-state probability of the 



Backlogged state P(o,o,i)- Hence, from Fig. [3] 

P(i,o,fc) = (1 - <z)P(o,o,i), for 1 < i < c, 1 < A; < /i, (2) 
(1 -«)(!-?) 



P 



(0,0,0) 



"^(0,0 



(0,0,1)- 



(3) 



Since J^i 2~2j 2~2k P(i,j,k) = 1' we can calculate the steady- 
state probability of every state in the Markov chain. Note 
that the probability of a collision among SUs, q, depends on 
the channel selection scheme. The derivation of q is given in 
Section HV] 

2) SUs Coexist with PUs in a Network: If the probability 
that a PU packet arrives in a time slot is not equal to zero 
(i.e., p^O), collisions between SUs and PUs may occur when 
a SU transmits a frame. Thus, the steady-state probabilities of 
the Collided states are not zero. Similar to the no-PU case, 
we represent the steady-state probabilities in terms of P(o.o,i)- 
First of all, for the first tier in Fig. [3] we can obtain the steady- 
state probabilities of all the Transmitting states in terms of 
p (0,o,i). that is, 

P (i)0) i) = u(l - q)(l-pyP {0fi ,i), for 1 < i < c. (4) 
Then, for the Collided states with i = 0, 

P(o,j,i) = «p(1 - q)P(o,o,i), for 1 < i < c (5) 
For the Collided states with i > 0, 

P(i,j,i)=u(l-q)p{l-pYP(Q,o.i), for l<i<c-l,l<i<c. 

(6) 

For the fc-th (fc > 1) tier, we first derive P(i.o,fc) an d -P(o.i,fc) : 
P(i,o,fe) = (1 ~p)P(cfi,k-i) +u(l -p)(l -q)P(o,o,k), (7) 
P(o,i,fe) = pP(c,o,k-i) + up{\ - q)P( ,o,k) ■ (8) 

Then, the steady-state probabilities of the Transmitting states 
when i > 1 can be represented as 



(i,0,fc) 



(1 -p) 1 1 P(i,o,k), for K i < c 



(9) 



Similar to the derivation method for the first tier, for the 
Collided states with i = 0, 

P(o,m =-P(o,i,fe), forl<J<c. (10) 
For the Collided states with i > 0, 

P(i,i,fe)=p(l-p)"P(i,o,fe), for l<i<c-l,l<j<c. (11) 
Then, for the Backlogged state in the fc-th tier, 

c-l 

^ P(i,c-i,k) = "(1 - q)P(o,o,k)- (12) 

i=0 

Combining (Q through (1121 1. we obtain the following equations 
using basic mathematical manipulations: 

1 



P(i,o,k) 



P(o,i,k) = 



(i- P y- 
p 

(i-p> 



-P 



(c,0,fe-l); 



(13) 
(14) 



_ 1-(1-P) C 
P(0 ^ ' fe) - ( c '°' fc - 1 )- (15) 

Then, from (O, 

P(c,o,fc-i) = (l-p) c " 1 P(i,o,fc-i). (16) 
Combining ( TO! ) and ( TToT ). we find the following relationship: 



P(c,0,k) — P(c,0,k- 



(17) 



Thus, 



P( c ,o,fc) - "(1 - g)(l -j5) c P (0 ,o,i)- (18) 
( fT8l indicates the steady-state probabilities of the states in the 
/c-th tier are independent of k. Now, we have all the steady- 
state probabilities of the states in all tiers except the state 
(0,0,0). At last, for the Idle state, 

P(o,o,o) = —u(l-q)(l- P ) c P m A)- (19) 



Similarly, since Y,iY,jY,k P (i,M) = !> we can 8 et the 
steady-state probability of every state in the Markov chain. 
If we denote as the normalized throughput of SU transmis- 
sions, is the summation of the steady-state probabilities of 
all the Transmitting states in our proposed Markov model. 
That is, h c 

= EE P (»Afe)- (20) 

fc=l i=l 

C. The Probability that at Least One Channel is Idle 

In the above derivations, u and q are unknown. In this sub- 
section, we calculate the probability that at least one channel is 
idle, u. In this paper, we only consider homogeneous PU traffic 
on each channel. Without loss of generality, we associate each 
PU with one channel and model the activity of each PU as 
an ON/OFF process fl3] ED (23]. SUs can only exploit the 
channels when the channels are idle (i.e., in the OFF period). 
We assume that the buffer in each PU can store at most one 
packet at a time. Once a packet is stored at a buffer, it remains 
there until it is successfully transmitted. Thus, we assume that 
the OFF period of a channel follows the geometric distribution, 
where the probability mass function (pmf) is given by 



Pt{N ff = n) = p(l - p) 7 



(21) 



where Noff is the number of time slots of an OFF period. 

Let tt(t) be the number of channels used by PUs at time slot 
t. The process {Q,(t),t = 0, 1, 2, • • • } forms a Markov chain 
whose state transition diagram is given in Fig. @] in which the 
self loops are omitted. To characterize the behavior of the PU 
channels, we define V l a as the event that / PUs finish then- 
transmissions given that there are a PUs in the network in a 
time slot. We also define AOf as the event that m PUs start 
new transmissions given that there are 7 idle PUs in a time 
slot. Thus, the probabilities of events V l a and are: 



Pr(^L)= , )v l (l-v) 



P m (i- P y 



(22) 



(23) 



where v is the probability that a PU finishes its transmission 
in a slot. If the average length of a PU packet is denoted as L, 
then v = l/L, Therefore, the state transition probability from 
state {il(t) — a} to state {il(t + l) = b} can be written as 



Pab = 



for b > a 
), for b < a. 



(24) 



Therefore, we can obtain the steady-state probabilities of the 
number of busy channels in the band in a time slot, denoted 
as § — [do 9i 92 • • • 9m] T , where gi denotes the steady- 
state probability that there are i busy channels in a time slot. 
Hence, u = J^tio 1 9i- 




Fig. 4. The transition diagram of the number of channels used by PUs in 
one time slot. 

IV. The Impact of Different Channel Selection 
Schemes 

In this section, we investigate the impact of different channel 
selection schemes on the performance of the spectrum handoff 
process in a multi-SU scenario by deriving the probability of 
a collision among SUs, q. 

A. Random Channel Selection 

For the random channel selection scheme, a SU selects 
an available channel for access on a random basis. Thus, a 
collision among SUs happens if more than one SU selects 
the same channel. To make the analysis tractable, we assume 
that the SU traffic is saturated (i.e., after finishing transmitting 
a packet, a SU always has another packet in the buffer to 
send). Thus, let B(t), T(t), and C(t) be the number of 
SUs in the Backlogged, Transmitting, and Collided state at 
time slot t, respectively. Therefore, B(t)+T(t)+C(t) = N. 
The process {B(t), T(t),C(i), t = 1, 2, ■ • • } forms a Markov 
chain, namely the system chain. Thus, we denote the state 
transition probability of the system chain from (n\, 712,713) 
to (n[,n' 2 ,n' 3 ) as ^(( ni ,n 2 ,n3),(ni,n^n0)- Let X w {n 2 ) be the 
probability that w number of SUs in the Transmitting state 
successfully finish their transmissions at time slot t given that 
there are n 2 SUs in the Transmitting state. Then, 



X w (n 2 ) 



"2 



o- w (l 



(25) 



where a is the probability that a SU finishes a packet transmis- 
sion in a slot. Let Y r (n2,w) be the probability that r SUs in 
the Transmitting state collide with PU packets in the next 
time slot given that n 2 SUs are in the Transmitting state 
and w SUs out of 77,2 SUs finish their transmissions. Thus, 

Y r (n 2 ,w)= (^ 2 ~ W ^jp r {l-p) n2 ~ w - r . (26) 

Let Z e (n) be the probability that e of 71 3 users transmit the 
last time slot of a frame in the current slot given there are 713 



SUs in the Collided state. Then, 



"3 



Z e (n 3 )= °\p%l-p f ) 



(27) 



where pf is the probability that the current time slot is the end 
of a frame. Since the frame length is c time slots, pf = -. Let 
Td{ni,d) be the probability that d SUs successfully access the 
channels given that there are n\ SUs in the Backlogged state 
and 9 available channels in the band. Then, 

S d {ni,0) 



T d (m,0) = 



'0+m-i\ 

\ ni / 



(28) 



where S d (ni,9) is the number of possibilities that d of ni 
SUs select a channel that is only selected by one SU given 
that there are 9 channels available. The denominator in (l28l l is 
the total number of possibilities that ni SUs select 9 available 
channels. S d (n\,9) can be calculated using the following 
iterative equation: 

-Ud+i(nx,6)- 

f d + i\ fd + i 
d j~U+l 



S d (nx,d) =U d {m,e)- 



ni — d 



(29) 



where U d (rii,6) = ( n d ) {"^gZ 2 /^ 1 ) ■ The proof of <|29]l is 
given in the Appendix. Since n 2 = N — n\ — n 3 , we can 
remove 77,2 from the state space and reduce the state space 
from three dimensions to two dimensions. Thus, the system 
chain becomes a two-dimensional Markov chain {B(t), C(t)}. 
The state transition probability is 



M 



K, 



((ni,n 3 ), («i,n^)) 



EE 

9=0 e=0 



n 3 N -rii-^ 13 



w=Q 



-^ni^i^-f-tofe (^1 



(30) 



Y n > 3+e - n3 (N - Til - 77,3, w) 

X w {N-n x -n 3 )Z e (n 3 )Pr(0), 

where Pi(9) is the steady-state probability that there are 9 
channels available in the band, which can be obtained in 
Section IlILCl 

We further reduce the two dimensional system chain 
{B(t), C(t)} with the state transition probability matrix 



K, 



((m,n 3 ),(ni,n^)) 



to a one dimensional Markov chain 



with the state transition probability matrix H^ mm i^ 



K, 



((m,n 3 ),(iii,n^)) 



where 



"3 



(2jV-ni+3)7ti 

_ (2JV-«' 1 +3)n' 1 , 
— 2 h U 3 



(31) 



Let 7r m be the steady-state probability for state m, < m < 
(iV+i)(iV+2) ^ Q ^ tne ojjg.^jjnejjgjojjaj Markov chain with the 

state transition probability matrix Ht m rn iy By solving the 

(JV + l)(JV + 2) ' 

equilibrium equation ^' m ~^2 m= Q 2 ^mH( m _ m i) with the 

(iV + l)(W + 2) 

condition J2m=o 2 K m = L we can obtain the steady-state 
probability 7r m . We denote the steady-state probability that 
there are k SUs in the Backlogged state as p^. p^. can be 
calculated by adding all the 7r m in which m should be: 

_ (2N -k + 3)k 



+ 3, Vj€[0,N-k]. 



(32) 



Thus, 



Pk 



\N -k 

E 



(33) 



Thus, the probability that a collision occurs among SUs when 
they randomly select a channel for each SU is obtained by 



M N 

EE 

= 1 A— 1 



1 



■k-2 



Pk Pr(0). 



(34) 



B. Greedy Channel Selection 

For the greedy channel selection scheme, a SU always 
selects the channel which leads to the minimum service time 
[9 1. If more than one SU pair perform spectrum handoffs at the 
same time, this channel selection method will cause definite 
collisions among SUs. Thus, the probability that a collision 
occurs among SUs is given by: 

J for TV = i 
q = { 1 for JV > 1. (35) 
Note that in this channel selection scheme, both the SU 
transmitter and receiver do not need to exchange information 
on the selected channel. Thus, the transition probability from 
the Collided states to the corresponding Backlogged state 
is 1 — u instead of one. In addition, under homogeneous PU 
traffic, the greedy channel selection scheme is equivalent to 
the random channel selection scheme. A part of the modified 
state transition diagram for the first tier is shown in Fig. 
The derivation of the steady-state probabilities of this modified 
model can be carried out in the way as in Section IIII-BI 




Fig. 5. The modified Markov model based on the greedy channel selection 
scheme. 

C. Pseudo-Random Selecting Sequence based Channel Selec- 
tion 

A channel selection scheme is proposed based on a pseudo- 
random selecting sequence fill . When multiple SUs perform 
spectrum handoffs at the same time, a pseudo-random se- 
lecting sequence for each SU is generated locally. SUs need 
to perform spectrum handoffs following the same selecting 
sequence to select channels to avoid collisions. Thus, for this 
channel selection scheme, the probability of a collision among 
SUs is always zero (i.e., q — 0). 

D. Results Validation 

In this subsection, we validate the numerical results obtained 
from our proposed Markov model using simulation. Note that 
when the number of SUs in the network is larger than two, 
the throughput using the greedy channel selection scheme for 
spectrum handoff is always zero because q=l. Thus, we first 
validate our numerical results in a two-SU scenario, where the 
number of PU channels, M — 10. The number of frames in a 



SU packet, h = l, and the number of slots in a frame, c=10. 
We assume that the SU packets are of fixed length. Thus, 
a = 4-. Fig. [6] depicts the analytical and simulation results 
of the normalized SU throughput using the random channel 
selection scheme and the greedy channel selection scheme. 
In the simulation, only data frames are considered for the 
calculation of the throughput. Signaling packets (RTS/CTS) 
are not. It can be seen that the simulation results match 
extremely well with the numerical results in both schemes with 
the maximum difference only 3.84% for the random selection 
and 4.09% for the greedy selection. It is also shown that, under 
the same SU traffic load, the greedy channel selection scheme 
always outperforms the random channel selection scheme in 
terms of higher SU throughput. 



Random selection analytical 
Random selection simulation 
Greedy selection analytical 
Greedy selection simulation 
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Fig. 6. Analytical and simulation results of the normalized SU throughput 
in a two-SU scenario. 

Then, we consider a network with 10 SU pairs in the 
network. We fixed the SU traffic at s = 1. The rest of the 
parameters are the same as in the two-SU scenario. Fig. |7] 
shows that, under different channel selection schemes, the an- 
alytical and simulation results match well with the maximum 
difference only 6.14% for the random selection and 1.2% for 
the pseudo-random sequence selection. Fig. Q also indicates 
that the pseudo-random sequence selecion outperfoms the 
random selection, especially when PU traffic is high. 



- Random selection analytical 
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Fig. 7. Analytical and simulation results of the normalized SU throughput 
under different channel selection schemes in a twenty-SU scenario. 

V. The Impact of Spectrum Sensing Delay 

In this section, we investigate the impact of the spectrum 
sensing delay on the performance of a spectrum handoff 



process. The spectrum sensing delay considered in this paper 
is defined as the duration from the moment that a collision 
between a SU and PU happens to the moment that the SU 
detects the collision (i.e., the overlapping time between a SU 
and PU transmission). Let T s be the spectrum sensing delay. 
Therefore, a SU does not need to wait till the last time slot of a 
frame to realize the collision, as shown in Fig. [2] It only needs 
to wait for T s to realize that a collision with a PU packet occurs 
and stops the current transmission immediately. In a recent 
work [10], the spectrum sensing time is considered as a part 
of the spectrum handoff delay. However, the definition of the 
spectrum sensing time in iflOl is different from the definition 
considered in this paper. In [10], the spectrum sensing time 
only refers to the duration that a SU finds an available channel 
for transmission after a collision occurs. Thus, the spectrum 
sensing time can be as low as zero in IflOl . In addition, the 
overlapping time of a SU and PU collision is neglected in 
1 1 1 . However, the spectrum sensing delay considered in this 
paper is not negligible. 

The spectrum sensing delay, T s , can be easily implemented 
in our proposed three dimensional Markov model with minor 
modifications. Fig. [8] shows the first tier of the modified three 
dimensional discrete-time Markov chain when T s equals 3 
time slots. It is shown that, for a fixed N t (t), the maximum 
number of Collided states is T s . The modified model of other 
tiers is similar to the first tier as shown in Fig. [8] 



qu+(l-u) 




Nf(t)=l 



Fig. 8. The modified Markov model based on the spectrum sensing delay 
when T s equals 3 time slots. 

Compared with the original Markov model shown in Fig. [5] 
the derivation of the steady-state probabilities of the Markov 
model implemented with the spectrum sensing delay is exactly 
the same. The only difference is that the total number of the 
Collided states in the modified Markov model is reduced from 
[c(c+l)/2]h in the original Markov model to [T s (c-T s +1)+ 
T s (T s -l)/2}h. 

Fig. [9] shows the impact of the spectrum sensing delay on 
the SU throughput performance. We consider a two-SU sce- 
nario with different spectrum sensing delay using the random 
channel selection scheme. It is shown that the numerical results 
and analytical results match well with the maximum difference 
1.83% for T a = 1 and 4.56% for T s = 6. It reveals that our 
proposed model can accurately predict the SU throughput. 
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Fig. 9. Analytical and simulation results of the normalized SU throughput 
under different spectrum sensing delay. 

VI. Performance Evaluation 

In this section, we use our proposed Markov model to 
evaluate the performance of SU transmissions in spectrum 
handoff scenarios under various system parameters. 

A. Collision Probability between SUs and PUs 

Based on the proposed Markov model, the collision prob- 
ability between SUs and PUs is the summation of all the 
steady-state probabilities of the Collided states. That is, 
Pi[collision] = Y,k=i Si=o Ej=i P (i,j,k)- Fig.[[0]shows the 
analytical and simulation results of the collision probability 
between SUs and PUs using the random channel selection 
scheme. The analytical results fit simulation results well with 
the maximum difference 6.26% for N = 2 and 3.41% for 
N = 6, respectively. It is shown that the collision probability 
between SUs and PUs decreases as the number of SUs 
increases. This is because that the number of collisions among 
SUs increases as the number of SUs during a spectrum handoff 
increases. Therefore, the probability for a SU being in the 
Backlogged states increases. Thus, the collision probability 
between SUs and PUs drops. 
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Fig. 10. Analytical and simulation results of the collision probability between 
SUs and PUs. 



B. Average Spectrum Handoff Delay 

We denote D s as the average spectrum handoff delay. Since 
the spectrum handoff delay is equivalent to the dwelling time 



on the Backlogged state, we obtain 

oo 



(36) 



k=l 



where pd = qu+ (1 — u). Fig. QT| shows the analytical and 
simulation results of the average spectrum handoff delay using 
the random channel selection scheme. It is shown that as the 
number of SUs increases, the average spectrum handoff delay 
increases drastically. 
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Fig. 11. Analytical and simulation results of the average spectrum handoff 
delay. 

VII. Conclusion 

In this paper, a novel three dimensional discrete-time 
Markov chain is proposed to analyze the performance of SUs 
in the spectrum handoff scenario in a CR ad hoc network under 
homogeneous PU traffic. We performed extensive simulations 
in different network scenarios to validate our proposed model. 
The analysis shows that our proposed Markov model is very 
flexible and can be applied to various practical network sce- 
narios. Thus, our analysis provides insights into the spectrum 
handoff process for CR networks. This allows us to obtain the 
throughput and other performance metrics for various design 
requirements. Currently, no existing analysis has considered 
the comprehensive aspects of spectrum handoff as what we 
considered in this paper. Finally, although we focus on the 
spectrum handoff scenario in CR networks, the modeling 
techniques developed in the paper are quite general and 
are applicable to other multi-channel scenarios with multiple 
interacting users. 
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Appendix 



We now give the proof of ( 1291 1, Sd{n\,6) is the number 
of possibilities that d channels are selected by only one SU 
for each channel given that there are n\ SUs and 8 available 
channels. Let <P,j(«i, 8) be the number of possibilities that at 
least d channels are selected by one SU for each channel given 
that there are ri\ SUs and 6> available channels. Thus, 



S d (n u 0) = $ d (m,0) - $ d+ i(m,( 



(37) 



Then, we calculate $d{ni, &)■ We first select d channels out 
of ni with one SU on each channel. The total number of pos- 
sibilities is ('jj. Then, let the remaining rii~d SUs select the 
remaining — d channels. The total number of possibilities is 

rTr 1 )- H™. we denote U d (n u e) = ft) (^Z^ 1 ). 
Compare <f>d(ni,0) with Ud{n\,6), there are many repeated 



counts that need to be removed. We denote the number of 
repeated counts as Td(n>i,0). 

Note that for the d + i,i > 0, channels that are se- 
lected by only one SU, the number of repeated counts is 



fd+i\ 



1 



Sd+i(ni,0). Thus, the total number of repeated 



counts is 

r d (n u 9) 

Thus, 



E 



d + i 
d 



Sd+i{n\,9). 



$d(ni,9) = Ud(n 1 ,d)-T d (n 1 ,t 
Compare (|37]l through (|39), (|29) is obtained. 
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